Visual Storytelling
نویسندگان
چکیده
We introduce the first dataset for sequential vision-to-language, and explore how this data may be used for the task of visual storytelling. The first release of this dataset, SIND1 v.1, includes 81,743 unique photos in 20,211 sequences, aligned to both descriptive (caption) and story language. We establish several strong baselines for the storytelling task, and motivate an automatic metric to benchmark progress. Modelling concrete description as well as figurative and social language, as provided in this dataset and the storytelling task, has the potential to move artificial intelligence from basic understandings of typical visual scenes towards more and more human-like understanding of grounded event structure and subjective expression.
منابع مشابه
The Effectiveness of Storytelling on Improving Auditory Memory of Students with Reading Disabilities in Marivan City, Iran
Background: Students with learning disabilities often encounter problems with their lessons due to the disorder in reading and writing and face to some challenging situation such as auditory and visual memory problem, sustaining attention, inhibiting impulses, motor coordination, auditory and visual perception and discrimination. The purpose of this study was to investigate the effectiveness of...
متن کاملVisual Storytelling Warehouse
In this paper, we introduce the concept of Visual Storytelling Warehouse, an interactive XML-based automatic cartoonstyle visual storytelling system to generate new stories based on written story structures and user’s requirements. The Warehouse will consist of the visual and no-visual elements including characters, events, background images, and story plots. Each of these elements will be asso...
متن کاملAutobiographical Visualizations: Challenges in Personal Storytelling
Copyright is held by the author/owner(s). A Personal Perspective on Visualization and Visual Analytics @DIS’14, June 21th – 25th, 2014, Vancouver, BC, Canada. Abstract The extensive digital archives of personal data that we collect over the period of a lifetime can support new ways of autobiographical storytelling. Autobiographical visualizations are visual representations based on these reposi...
متن کاملStorytelling in Visual Analytics Tools for Business Intelligence
Stories help us communicate knowledge, share and interpret experiences. In this paper we discuss the use of storytelling in Business Intelligence (BI) analysis. We derive the actual practices in creating and sharing BI stories from in-depth interviews with expert BI analysts (both story “creators” and “readers”). These interviews revealed the need to extend current BI visual analysis applicatio...
متن کاملGeovisual analytics framework integrated with storytelling applied to HTML5
The paper considers how the integration between visualization and storytelling can make statistical findings more comprehensible and accessible to the general public. Traditional practices for geovisual analytics methods applied to official statistics require tools for greater user participation and an improved user experience. The approach set out in this paper allows the analyst (the author) ...
متن کامل